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(54) Exposure control for video cameras 

(57) A video camera system and method is capable 
of automatically controlling the exposure of a desired 
object image. A plurality of average luminance values 
(S7, S8, S9) are respectively determined by a plurality 
of light measurement units (12, 9, 10). A plurality of ref- 
erence luminance values (S10, S11) are obtained from 
a plurality of reference value circuits (13, 14). Selected 
ones of the average luminance values (S7, SB, S9) and 
the reference luminance values (S10, S11) are utilized 
to form control signals (S14). The control signals (S14) 
control a lens block section (50) of the video camera so 
as to maintain proper exposure of the desired object. 
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Description 

The present invention relates to video cameras, and 
in particular to techniques for following a change of an 
object in the field of view of a video camera and for con- 
trolling the exposure so as to adjust the luminance of 
the object. 

Numerous methods may be employed for control- 
ling the exposure of a video camera. For example, such 
methods may include an automatic multi-split light 
measurement exposure control method, an automatic 
centralised or spot light measurement exposure control 
method, a manual exposure control method and so 
forth. 

The automatic multi-split light measurement expo- 
sure control method utilizes a multi-split light measure- 
ment pattern to measure luminance information ob- 
tained from picture information. The measured lumi- 
nance information may be processed to obtain an aver- 
age value, a distribution, and/or a histogram of such lu- 
minance information which may be utilized to control ex- 
posure. 

The automatic centralized or spot light measure- 
ment exposure control method utilizes a light measure- 
ment pattern which may be respectively located in or 
around the center portion of a screen and in a relatively 
small or spot area in or around such center portion. Lu- 
minance information obtained from picture information 
is measured by use of the light measurement pattern 
which may be utilized to control exposure. 

In the manual exposure control method, an operator 
or cameraman may determine and/or manually adjust 
the luminance of an object to be photographed to obtain 
a desired or acceptable value. 

Each of the above-mentioned exposure control 
methods has disadvantages associated therewith. For 
example, the automatic multi-split light measurement 
exposure control method may have difficultly in obtain- 
ing a proper exposure of an object in a scene having a 
relatively large luminance difference between the object 
and its background (such as in a scene having a back- 
light or excessive normal light). In such situation, the 
background information may be incorporated with infor- 
mation of the object to be photographed, thereby mak- 
ing it difficult to obtain a proper exposure of the object. 
Further, with regard to the automatic centralized or spot 
light measurement exposure control method, such 
method may be difficult to use when the object to be 
photographed is moving. That is, in such method, the 
operator or cameraman has to photograph the object 
such that it is always located at the center of a screen. 
As is to be appreciated, it may be difficult to continuously 
photograph the object so as to keep it centered on the 
screen while the object is moving. Furthermore, with re- 
gard to the manual exposure control method, an oper- 
ator may not be able to properly adjust the exposure 
control in response to a sudden luminance change of 
an object. Additionally, a problem may arise in that the 



background may not be set to an optimum luminance 
level when an object suddenly disappears from a pho- 
tographing screen. 

In accordance with an aspect of the present inven- 
s tion, a video camera system is provided. Such system 
comprises a picture information temporary storage de- 
vice having a temporary memory for dividing a video sig- 
nal obtained from at least one video camera into lumi- 
nance information and color information and for storing 
10 picture information composed of the luminance informa- 
tion and the color information in the temporary memory 
at an arbitrary timing; an object recognizing and tracking 
device for recognizing, extracting and tracking a dis- 
played object from the picture information stored in the 
is temporary memory; a tracked object initialization device 
for storing characteristic values of the tracked object; a 
tracked object extraction and light measurement device 
for extracting and integrating only the luminance infor- 
mation of the tracked object and for calculating an av- 
20 erage value; a recognized color extraction and light 
measurement device for extracting color information 
having the same color as the recognized object, inte- 
grating the corresponding luminance information, and 
calculating an average value; a centralized light meas- 
es urement device for integrating the luminance informa- 
tion of the object in or around the center portion of a 
screen and calculating an average value; a spot light 
measurement device lor integrating the luminance in- 
formation in a relatively small area in or around the cent- 
30 er portion of the screen and calculating an average val- 
ue; a light-measuring method selection device for se- 
lecting the luminance information measured by the 
tracked object extraction and light measurement device, 
the recognized color extraction and light measurement 
35 device, the centralized light measurement device or 
spot light measurement device in accordance with the 
object condition; and an exposure control device for 
controlling an iris and/or an automatic gain controller of 
the video camera and adjusting the luminance of an out- 
40 put object to a constant value by using a selected lumi- 
nance average value and a luminance reference value. 

In accordance with another aspect of the present 
invention, a video camera exposure control method is 
provided. Such method comprises dividing a video sig- 
45 nal obtained from a video camera into luminance infor- 
mation and color information and storing picture infor- 
mation including the luminance information and the 
color information in a temporary memory at an arbitrary 
timing; recognizing, extracting and tracking a displayed 
50 object from the picture information stored in the tempo- 
rary memory; storing characteristic values of the tracked 
object; extracting and integrating only the luminance in- 
formation of the tracked object and calculating a first av- 
erage value; extracting color information having the 
55 same color as the recognized object, integrating the cor- 
responding luminance information, and calculating a 
second average value; integrating the luminance infor- 
mation of the object around the center portion of a 
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screen and calculating a third average value; integrating 
the luminance information in a relatively small area 
around the center portion of the screen and calculating 
a fourth average value; selecting the luminance infor- 
mation of the first average value, the second average 5 
value, the third average value or the fourth average val- 
ue in accordance with the object condition; and control- 
ling an iris and/or an automatic gain controller of the vid- 
eo camera and adjusting the luminance of an output ob- 
ject to a constant value by using the selected luminance 10 
average value and a luminance reference value. 

The luminance information and color information 
stored in the picture information temporary storage de- 
vice may be read out and supplied to the centralized light 
measurement device or spot light measurement device, is 
the recognized color extraction and light measurement 
device, the object recognizing and tracking device, and 
the tracked object extraction and light measurement de- 
vice in accordance with a command signal which may 
be supplied by the light-measuring method selection de- 20 
vice. The recognized color extraction and light measure- 
ment device calculates a luminance average value of 
pixels having information which is relatively close to the 
recognized color. The object recognizing and tracking 
device and the tracked object extraction and light meas- 2S 
urement device extract only the recognized object and 
calculate its average luminance value. The centralized 
light measurement device or spot light measurement 
device calculates a average luminance value of a center 
portion of a screen or in a relatively small area of such 30 
center portion, respectively. The light-measuring meth- 
od selection device determines or selects a luminance 
average value from among the calculated luminance av- 
erage values in accordance with the object condition or 
present operating conditions, and further selects a ref- 35 
erence value. The selected luminance average value 
and reference value may be compared by the exposure 
control device so as to obtain a signal which may be 
utilized to properly adjust the luminance value of an ob- 
ject. 40 

Other aspects of the invention are set out in claims 
1, 2, 13, 14, 25, 26, 28, 29, 30 and 32. 

A preferred embodiment of the present invention 
provides a system and method lor properly controlling 
the exposure of a video camera for an object to be pho- 45 
tographed, in which luminance values are selected from 
among a plurality of luminance values and in which the 
selected luminance values are utilized to control the ex- 
posure of the video camera; the plurality of luminance 
values preferably includes a plurality of average lumi- so 
nance values each calculated by a respective tech- 
nique, as well as at least one reference luminance value. 

The invention will now be described by way of ex- 
ample with reference to the accompanying drawings, 
throughout which like parts are referred to by like refer- 55 
ences, and in which: 

Fig. 1 is a diagram of a video camera system for 



performing object recognition and automatic expo- 
sure adjustment according to an embodiment of the 
present invention; 

Fig. 2 illustrates a section of an image screen 
wherein a centralized light measurement device of 
the video camera system of Fig. 1 performs lumi- 
nance integrating and average value calculating; 
Fig. 3 illustrates a section of an image screen 
wherein a spot light measurement device of the vid- 
eo camera system of Fig. 1 performs luminance in- 
tegrating and average value calculating; 
Fig. 4A is a diagram of an image to which reference 
will be made in explaining light measurement meth- 
ods; 

Figs. 4B and 4C are diagrams to which reference 
will be made in explaining light measurements per- 
formed by the centralized light measurement device 
of the video camera system of Fig. 1 ; 
Figs. 5A to 5D are diagrams to which reference will 
be made in explaining light measurements per- 
formed by other devices of the video camera sys- 
tem of Fig. 1 ; 

Figs. 6 and 7 are flow charts to which relerence will 

be made in explaining a recognized color extraction 

and light measurement procedure; and 

Fig. 8 is a flow chart to which reference will be made 

in explaining a light-measuring method selection 

procedure. 

Referring to the drawings, Fig. 1 illustrates a video 
camera system (VCS) which is capable of performing 
object recognition and automatic exposure adjustment. 
As shown therein, such VCS generally includes a lens 
block section 50, a sample and hold (S/H) and automatic 
gain control (AGC) circuit 4, an analog-to-digital (A/D) 
circuit 5, a luminance and color difference signal gener- 
ator 6, an image temporary memory 7, a recognized 
color extraction and light measurement unit 9, an object 
recognizing and tracking unit 10, a tracked object ex- 
traction and light measurement unit 11 , a tracked object 
initialization unit 8, a centralized light measurement/spot 
light measurement unit 12, a light-measuring method 
selector 15, an exposure controller 16 and a driver 17 
which are connected as shown. The lens block section 
50 includes a lens 1 , an iris 2 and a solid pickup or 
charge coupled device (CCD) 3. 

Image pickup light LA from an object is supplied 
through the lens 1 and the iris 2 to the CCD 3, where- 
upon a pickup signal S1 which represents a field-of-view 
picture is generated and supplied to the S/H and AGC 
4. The S/H and AGC is adapted to sample and hold the 
received pickup signal S1 and to perform or adjust the 
gain thereof in accordance with an AGC control signal 
S16 from the exposure controller 16 so as to produce a 
pickup signal S2. Such pickup signal S2 is converted to 
a digital pickup Signal S3 by the A/D converter 5. The 
digital pickup signal S3 is supplied to the luminance and 
color difference signal generator 6. 
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The luminance and color difference signal genera- 
tor 6 is adapted to receive the digital pickup signal S3 
and to generate therefrom a luminance (Y) signal S4, a 
color difference (R-Y) signal S5 and a color difference 
(B-Y) signal S6. Such luminance and color difference s 
signals are supplied to the image temporary memory 7, 
whereupon they are respectively preprocessed as an 
object tracking detection signal and an object luminance 
light-measuring signal. Such preprocessing may in- 
clude a thinning out operation in which the number of io 
samples of the luminance data are decreased, where- 
upon the total number of data bits processed are re- 
duced thereby reducing or improving the sampling fre- 
quency and/or processing speed. The preprocessed 
signals are stored in an image memory or memories, is 
That is, three image memories 51, 52 and 53 may be 
utilized, wherein the luminance picture information is 
stored in the image memory 51 , the color difference (R- 
Y) picture information is stored in the image memory 52, 
and the color difference (B-Y) picture information is 20 
stored in the image memory 53. Such stored picture in- 
formation maybe randomly-accessed by the centralized 
light measurement/spot light measurement unit 12, the 
recognized color extraction and light measurement unit 
9, the object recognizing and tracking unit 10, and the 2s 
tracked object extraction and light measurement unit 1 1 . 
More specifically, when stored picture information is de- 
sired, the unit requesting such information supplies a 
signal, such as an address signal (ad1, ad2 or ad3) 
which indicates the address or tocation or the desired 30 
stored picture information, to the image memories. As 
a result, the requested information is supplied to the re- 
spective unit by way of signal da1 , da2 or da3. As an 
example, consider the situation in which the centralized 
light/spot light measurement unit 1 2 wishes to obtain the 35 
stored luminance picture information from the image 
memory 51 . In such situation, the unit 12 supplies a re- 
quest or address signal ad1 to the image memory 51, 
whereupon signal da1 having the requested luminance 
picture information is supplied to the unit 12. 40 

The centralized light measurement/spot light meas- 
urement unit 12 receives the requested stored lumi- 
nance picture information from the image temporary 
memory 7, as previously described, and generates 
therefrom an average value of the luminance informa- 
tion contained within a predetermined portion. For ex- 
ample, the centralized light measurement/spot light 
measurement unit 12 may generate an average value 
of the luminance information in a center portion 98 of an 
image screen 97 which is indicated by a cross-hatched so 
or shaded portion in Fig. 2. In this example, the center 
portion or area 98 has a size of X/3 x Y/3, in which the 
horizontal dimension of the screen 97 is X and the ver- 
tical dimension ol the screen is Y As is to be appreciat- 
ed, other sizes of such center portion may be utilized. 55 
The centralized light measurement unit 12 supplies the 
generated average value of the center luminance infor- 
mation (which may be referred to as a centralized light 



measurement) as an output signal S7 to one terminal of 
a switch sw1 of the light -measuring method selector 15. 

An example of the procedure performed by the cen- 
tralized light measurement unit 12 is illustrated in Figs. 
4A, 4B and 4C. That is, Fig. 4A illustrates a image on 
which the unit 12 is to determine an average value of 
the center luminance information. The light measured 
or center portion of such image is indicated as a shaded 
area in Fig. 4B. The information contained within this 
shaded area is processed by the unit 1 2 so as to deter- 
mine the centralized light measurement or average lu- 
minance levels (light values) as illustrated in Fig. 4C. 

The centralized light measurement unit/spot light 
measurement unit 12 may further generate an average 
value of the luminance information obtained from the 
signal da1 pertaining to a relatively small predetermined 
portion or spot of the image screen 97. Such predeter- 
mined portion may be at the center portion of the image 
screen 97 as, for example, indicated by a shaded portion 
99 in Fig. 3. In this example, and in a manner similar to 
that previously described with reference to Fig. 2, the 
unit 12 determines an average value of the luminance 
information contained within the center portion or area 
having a size of X/10 x Y/10 (in which the horizontal di- 
mension of the screen 97 is Xand the vertical dimension 
of the screen is Y). Such area 99 is smaller or narrower 
than the area 98 of Fig. 2. As is to be appreciated, other 
sizes of the spot area may be utilized. The spot light 
measurement unit 12 supplies the generated average 
value of the center spot luminance information (which 
may be relerred to as a spot light measurement) as the 
output signal S7 to one terminal of the switch swt of the 
light-measuring method selector 15. 

In response to a request, the object recognizing and 
tracking unit 10 may receive the luminance information 
signal da1 and the color difference information signals 
da2 and da3 from the image temporary memory 7. The 
object recognizing and tracking unit 10 may further re- 
ceive an instructing or trigger signal S17. In response to 
such signal S1 7, the object recognizing and tracking unit 
10 extracts and holds characteristic values or informa- 
tion, which may include position information, of a de- 
sired object contained within the image represented by 
the respective luminance and color difference signals in 
a hold area of the unit 10. The hue of such object, or 
recognized hue, is supplied to the recognized color ex- 
traction and light measurement unit 9. 

The tracked object extraction and light measure- 
ment unit 11 may receive an instructing signal S17 and 
information pertaining to the recognized and tracked ob- 
ject from the object recognizing and tracking unit 10. The 
tracked object extraction and light measurement unit 11 
may integrate only the luminance information of tne ob- 
ject extracted by the object recognizing and tracking unit 
10 and average the same so as to form an average value 
S9. Such average value S9 is supplied from the tracked 
object extraction and light measurement unit 11 to one 
terminal of a switch sw3 of the light-measuring method 
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selector 1 5. An example of the procedure performed by 
the tracked object extraction and light measurement unit 
11 is illustrated in Figs. 5Aand 5B. In this example, the 
.center piece of fruit or apple of the image of Fig. 4A is 
the recognized or tracked object and, as such, is shown 
as a shaded object in Fig. 5A. The information contained 
within this shaded area is processed by the unit 11 so 
as to determine the light measurement or average lumi- 
nance values as illustrated in Fig. 5B. 

Further, in response to the signal S17, the tracked 
object extraction and light measurement unit 11 may 
hold the luminance average value S9 of the tracked ob- 
ject in a hold area of the unit 11 and may cause such 
average value to be supplied to an object recognized 
color extraction/object recognizing, tracking and light- 
measuring reference luminance value generating circuit 
1 3 so that a reference luminance value signal S10 may 
be produced therefrom. Such signal S10, which may 
represent an average of the luminance of the extracted 
object prior to autotracking, is supplied from the circuit 
1 3 to one terminal of a switch sw4 of the light-measuring 
method selector 15. 

The recognized color extraction and light measure- 
ment unit 9 may receive the luminance information da1 , 
the color difference information da2 and da3, and the 
recognized hue information from the object recognizing 
and tracking unit 10 as previously described. The unit 9 
is adapted to process the received information so as to 
* determine other locations or objects of the respective 
image (such as that of Fig. 4A) which have hues sub- 
stantially similar to that of the recognized hue from the 
unit 10. More specifically, the unit 9 extracts information 
from the color difference signals R-Y and B-Y so as to 
determine locations or points having substantially the 
same hue as the recognized color among the luminance 
information da1 from the image memory 7, integrates 
the values of the determined points, averages the inte- 
grated values to obtain an averaged value S8, and sup- 
plies such average value S8 to one terminal of a switch 
sw2 of the light measuring method selector 1 5. To avoid 
or minimize count errors of the luminance of the same 
hue of noise component(s) in a black object or an envi- 
ronment color in a white object, black and environment 
colors may be checked. 

An example of the procedure performed by the rec- 
ognized color extraction and light measurement unit 9 
is illustrated in Figs. 5C and 5D. In this example, the hue 
or color of the center piece of fruit (or apple) of Fig. 5A 
is the extracted or recognized color. Accordingly, the unit 
9 determines other-locations or objects within the image 
of Fig. 4A having substantially the same hue as that of 
the apple. As a result, objects such as the three cherries 
which have substantially the same color as that of the 
apple are identified or extracted. These objects are 
shaded in a similar manner to that of the apple as shown 
in Fig. 5C. The area of the apple having an oval shape 
which is not shaded represents an area which may be 
affected by so-called "white saturation" or "black crush- 



ing". (White saturation may be caused by over-expo- 
sure, whereas black crushing may be caused by under- 
exposure.) The information contained within the shaded 
areas of Fig. 5C are processed by the recognized color 
s extraction and light measurement unit 9 so as to deter- 
mine the light measurement of average luminance val- 
ues as illustrated in Fig. 5D. 

As may be observed from Figs. 4C, 5B and 5D, the 
average luminance levels or light values of similar ob- 
jects (such as the apple) appear slightly different from 
figure to figure. Such minor discrepancy may be due to 
somewhat different conditions which may exist when 
these figures were captured or picked-up (such as dif- 
ferent background brightness). 

The processing performed by the recognized color 
extraction and light measurement unit 9 will now be de- 
scribed with reference to the flow chart illustrated in 
Figs. 6 and 7. Fig. 6 illustrates the processing in which 
luminance levels except a black portion and noise are 
averaged and the presence of an object is determined. 
Fig. 7 illustrates the processing wherein, in the presence 
of an object, Ymin/Ymax are set again to calculate Y 
average. 

Processing is initiated in step SPO and proceeds 
therefrom to steps SP1 and SP2 wherein a luminance 
level and a degree of saturation are respectively set. 
Thereafter, processing proceeds to step SP3 whereup- 
on the degree of saturation of each pixel is checked. It 
the saturation is less than a predetermined amount, then 
30 processing returns to step SP3 If, however, the satura- 
tion is- more than the predetermined amount, then 
processing proceeds to step SP4 wherein the hue of 
each pixel is checked. If the hue is not the recognized 
color, then processing returns to step SP3. If the hue is 
35 the recognized color, then processing proceeds to step 
SP5 whereat the luminance of each pixel is checked. If 
the luminance is less than a predetermined amount, 
then processing returns to step SP3. However, if the lu- 
minance is more than the predetermined amount, then 
40 processing proceeds to step SP6 whereat the lumi- 
nance values are integrated. Thereafter, the number of 
pixels having the same hue are counted at step SP7. 

After step SP7, processing proceeds to step SPB, 
whereupon a determination is made as to whether all 
45 the pixels were observed. If such determination is neg- 
ative, processing returns to step SP3. If, however, this 
determination is affirmative, processing proceeds to 
step SP9 wherein a determination is made as to whether 
the object is present by determining if the count number 
so is less than a reference value. 

If the determination in step SP9 is affirmative, 
processing proceeds to step SP21 wherein it is decided 
that there was no object. Thereafter, processing is ter- 
minated at step SP20. 
55 On the other hand, if the determination in step SP9 
is negative, then processing proceeds to step SP10 
wherein an average luminance value is calculated. 
Thereafter, processing proceeds to step SP11 , where- 
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upon upper and lower limits of the luminance are set. 

From step SP11, processing proceeds through 
steps SP12-SP19 which, with an exception at step 
SP14, are similar to steps SP3-SP9 and, as such, will 
not be further described. At step SP14 the luminance of 
each pixel is checked. If the luminance is less than a 
predetermined amount or greater than another prede- 
termined amount, then processing returns to step SP12. 
If, however such luminance lies within a predetermined 
range, then processing proceeds to step SP15. 

After step SP19, processing is terminated at step 
SP20. 

Returning to Fig. 1 : the tracked object initialization 
unit 8 produces the signal S17 which may be supplied 
to the object recognizing and tracking unit 10 and the 
tracked object extraction and light measurement unit 11 
as previously described. Such signal SI 7 may start and/ 
or stop automatic exposure adjustment and object track- 
ing. The tracked object initialization unit 8 may include 
a memory switch 18 arranged on the body or housing 
of the video camera which, upon activating, may cause 
a signal to be transmitted therefrom which may cause 
the signal S17 to be produced and/or the previously- 
mentioned operations to be initiated. Alternatively, a re- 
cording start switch of the video camera, a signal from 
the recording start switch, or a memory switch of a radio 
or cable remote controller or the like may be utilized in- 
stead of the memory switch 18 arranged on the video 
camera body- 
As previously described, the trigger signal S1 7 may 
be supplied to the object recognizing and tracking unit 
1 0 so as to cause characteristic values to be extracted 
and held and the recognized hue to be supplied to the 
recognized color extraction and light measurement unit 
9, and may also be supplied to the tracked object ex- 
traction and light measurement unit 11 so as to cause 
the luminance average value S9 of the tracked object to 
be held and an object recognized color extraction/object 
recognizing, tracking and light-measuring reference lu- 
minance value signal to be generated. 

Additionally, the tracked object initialization unit 8 
may generate a signal S1 9 and may supply the same to 
the light-measuring method selector 15. Such signal 
S19 provides an indication or one of a so-called pre- 
memory, memory and object tracking and exposure ad- 
justment modes and the like to the light-measuring 
method selector 15. Such modes will be hereinafter 
more fully described with reference to steps SP31 , SP35 
and SP41-SP33 of Fig. 8. 

As previously described, the light-measuring meth- 
od selector 15 receives the signal S7 from the central- 
ized light measurement/spot light measurement unit 12, 
the signal S8 from the recognized color and light meas- 
urement unit 9, the signal S9 from the tracked object 
extraction and light measurement unit 11 , and the refer- 
ence signal S10f rom the reference luminance value unit 
13. Additionally, the light-measuring method unit 15 re- 
ceives a reference signal S11 from a centralized light 



measurement reference luminance value generating 
circuit 14. In particular, such circuit 14 supplies the sig- 
nal S1 1 to one terminal of a switch sw5 at the light-meas- 
uring method selector 15. The circuit 14 may include a 
5 memory, such as read only memory (ROM), wherein the 
reference signal S11 is stored. 

Accordingly, the light-measuring method selector 
15 receives signals S7, S8 and S9 which contain aver- 
age values of luminance information respectively ob- 
to tained from units 12, 9 and 10, and the light-measuring 
method selector 1 5 further receives reference value sig- 
nals S10 and S11 from reference luminance value cir- 
cuits 13 and 14. The light-measuring method selector 
15 further receives the signal S1 9 from the tracked ob- 
75 ject initialization unit 8, as previously described. In re- 
sponse to the received signals, the light-measuring 
method selector 15 selects from among the luminance 
average values S7, S8 and S9 so as to form a selected 
signal S12, and selects from among luminance refer- 
ee ence values S10 and S11 so as to form a selected ref- 
erence signal S13. Such selection of signals may be 
performed by the selective opening and/or closing of 
switches sw1-sw5. 

The light-measuring method selector 1 5 may detect 
2S a tracked object unrecognizable or abnormal state in 
which a tracked object cannot be extracted by the 
tracked abject extraction and light measurement unit 11 . 
Such situation may occur, for example, during a white 
saturation or black crushing state which may result from 
30 a sudden luminance change or the like. In this situation, 
the light-measuring method selector 15 selects from 
among the luminance average value signals S7 and S8 
from the centralized light measurement unit or spot light 
measurement un it 1 2 and the recognized color and light 
3S measurement unit 9, and the reference luminance value 
signals corresponding thereto, as luminance informa- 
tion to obtain or recover an operating stale in which ex- 
posure may be controlled through tracked object extrac- 
tion and light measurement. 
40 The light-measuring method selector 15 may fur- 
ther detect a state in which luminance other than that of 
a tracked object if abnormal, for example, an extreme 
saturation state or extreme black crushing state. Such 
situation or state may occur when the tracked object 
45 hides or moves off or the screen. In such situation, the 
light-measuring method selector 15 selects the lumi- 
nance average value S7 from the centralized light meas- 
urement unit or spot light measurement unit 12 and the 
reference luminance value S11 (Which corresponds to 
so the signal S7) as luminance information. 

Furthermore, the light-measuring method selector 
15 may select the signal S7 from the centralized light 
measurement unit or spot light measurement unit 12 
and the reference luminance value S11 (corresponding 
ss to the signal S7) when the selector receives the instruc- 
tion signal S19 from the tracked object initialization unit 
8 prior to the initialization of an object as the luminance 
information. As a result, the luminance of the object to 
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,be recognized and extracted may be adjusted to an op- 
timum exposure. 

The light-measuring method selector 15 may fur- 
ther provide a picture information update signal S18 af- 
ter obtaining light measurement data. Such signal S18 
is supplied to the picture information temporary memory 
7. 

The above-mentioned operations performed by the 
light-measuring method selector 15 wilt now be further 
described with reference to the flow chart of Fig. 8. 

Processing initially proceeds from step SP30 to 
step SP31 whereupon a determination is made as to 
whether storing has begun. If the determination is af- 
firmative, processing proceeds to step SP32 whereupon 
the light measurement value signal S7 from the unit 12 
and the corresponding reference luminance value are 
selected. Thereafter, processing proceeds to step SP33 
whereupon a picture information update signal SI 8 is 
generated and supplied to the memory 7. 

If, on the other hand, the determination in step SP31 
is negative, processing proceeds to step SP35 where- 
upon a determination is made as to whether it is the first 
time through such step. If it is the first time, processing 
proceeds to step SP36 wherein the characteristics of the 
recognized object are stored. Processing then proceeds 
to step SP37 wherein the hue of the recognized color is 
stored. Thereafter, object recognition processing is per- 
formed in step SP38. The reference luminance value 
S10 is formed in step SP39. Processing then proceeds 
to step SP40 wherein the light measurement value sig- 
nal S8 from the unit 9 and the corresponding reference 
luminance value are selected. Thereafter, processing 
proceeds to step SP33. 

It the determination of step SP35 indicates that it is 
not the first time through, then processing proceeds to 
step SP41 wherein object recognition processing is per- 
formed. Thereafter, processing proceeds to step SP42 
whereupon a determination is made as to whether it is 
possible to extract the desired object. If it is possible, 
the light measurement value signal S9 and the corre- 
sponding reference luminance value are selected in 
step SP43. Processing then proceeds to step SP33. 

If the determination or step SP42 is negative, 
processing proceeds to step SP44 wherein a determi- 
nation is made as to whether the object moves off of the 
screen. It such determination is affirmative, processing 
proceeds to step SP45 wherein the light measurement 
value signal S7 and the corresponding reference lumi- 
nance value are selected. Processing then proceeds to 
step SP33. If, however, the determination in step SP44 
is negative, processing proceeds to step SP46 wherein 
the light measurement value signal S9from the unit 11 
and the corresponding reference luminance value are 
selected. Processing then proceeds to step SP33. 

Processing proceeds from step SP33 to step SP34, 
whereupon the selected signals are supplied to the ex- 
posure controller 16. 

Returning to Fig. 1, the selected signals S12 and 



S13from the light-measuring method selector 15 are re- 
spectively supplied to positive and negative inputs of a 
comparator or gain circuit 60 of the exposure controller 
16, which may function as an error detector. As a result, 

5 the comparator 60 produces a compared or error signal 
S1 4 which is supplied to an iris/AGC circuit 61 which, in 
turn, produces an iris signal S15 and the AGC signal 
S1 6. The iris signal S1 5 is supplied to an iris driver circuit 
17 so as to drive the iris, and the AGC signal S.1.6 is 

10 supplied to the S/H and AGC circuit 4 as previously de- 
scribed. As a result, the exposure controller 16 may con- 
trol the luminance and color difference signal generator 
6. 

Therefore, by extracting only the luminance of an 
is object to be photographed, the present invention ena- 
bles a light measurement to be obtained without being 
influenced by the background or other objects. Further, 
since th e present invention enables an obj ect to be light- 
measured while tracking, a cameraman photographing 
20 an object does not have to maintain such object in a light 
measurement area of a light measurement pattern. Fur- 
thermore, the present invention enables light measure- 
ment to be performed on the background around the 
center of an image screen when the object being pho- 
25 tographed moves off the screen. As a result, normal lu- 
minance may be maintained. 

Thus, the present invention provides a video cam- 
era which. determines a plurality of average values of 
luminance and a plurality of values of reference lumi- 
30 nance values, and which selects therefrom the appro- 
priate average luminance and reference luminance val- 
ues in accordance with operating conditions. Such se- 
lected values are utilized to generate control signals for 
controlling or adjusting the exposure of the video carri- 
es era so as to provide automatic and proper exposure con- 
trol even when photographing under adverse or harsh 
conditions, such as, when backlight and excessive nor- 
mal light (spot light) exists which may present serious 
problems for a conventional video camera. 
40 Although the present video camera was described 
as having a specific number of measurement units and 
reference value generating circuits, the present inven- 
tion is not so limited. Instead, other numbers of such 
units and reference value generating circuits may be uti- 
45 nzed. 

Although preferred embodiments or the present in- 
vention and modifications thereof have been described 
in detail herein, it is to be understood that this invention 
is not limited to these embodiments and modifications, 
50 and that other modifications and variations may be ef- 
fected by one skitted in the art without departing from 
the scope of the invention as defined by the appended 
claims. 

55 

Claims 

1. A video camera system, comprising: 
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picture information temporary storage means 
having a temporary memory for dividing a video 
signal obtained from a video camera into lumi- 
nance information and color information, and 
for storing picture information including said lu- s 
minance information and color information in 
said temporary memory; 
object recognizing and tracking means for rec- 
ognizing, extracting and tracking a displayed 
object in accordance with said picture informa- io 
tion stored in said temporary memory; 
tracked object initialization means for storing 
characteristic values of said tracked object; 
tracked object extraction and light measure- 
ment means for extracting and integrating only is 
said luminance information of said tracked ob- 
ject so as to calculate a first average value; 
recognized color extraction and light measure- 
ment means for extracting said calor informa- 
tion having the same color as said tracked ob- 
ject, and integrating corresponding luminance 
information so as to calculate a second average 
value; and 

exposure control means for controlling an iris 
and/or an automatic gain controller of said vid- 2S 
eo camera by utilizing said first average value 
obtained by said tracked object extraction and 
light measurement means or said second aver- 
age value obtained by said recognized color ex- 
traction and light measurement means and by 30 
utilizing a luminance reference value, and for 
adjusting the luminance of said object so as to 
be substantially constant. 

2. A video camera system, comprising: 

picture information temporary storage means 
having a temporary memory for dividing a video 
signal obtained from a video camera into lumi- 
nance information and color information, and 40 
for storing picture information including said lu- 
minance information and color information in 
said temporary memory; 
object recognizing and tracking means for rec- 
ognizing, extracting and tracking a displayed 
object in accordance with said picture informa- 
tion stored in said temporary memory; 
tracked object initialization means tor storing 
characteristic values of said tracked object; 
tracked object extraction and light measure- so 
ment means for extracting and integrating only 
said luminance information of said tracked ob- 
ject so as to calculate a first average value; 
recognized color extraction and light measure- 
ment means for extracting said color informa- 55 
tion having the same color as said tracked ob- 
ject, and integrating said corresponding lumi- 
nance information so as to calculate a second 



average value; 

centralized light measurement means for inte- 
grating said luminance information of a first ar- 
ea in a center portion of a screen so as to cal- 
culate a third average value; 
spot light measurement means for integrating 
said luminance information in a second area 
around the center portion of said screen which 
is smaller than said first area so as to calculate 
a fourth average value; 

light-measuring method selection means for 
selecting said first average value obtained by 
said tracked object extraction and light meas- 
urement means, said second average value 
obtained by said recognized color extraction 
and light measurement means, said third aver- 
age value obtained by said centralized light 
measurement means, or said fourth average 
value obtained by said spot light measurement 
means in accordance with an object condition; 
and 

exposure control means for controlling an iris 
and/or an automatic gain controller of said vid- 
eo camera by using the selected luminance av- 
erage value and a luminance reference value, 
and for adjusting the luminance of said object 
so as to be substantially constant. 

3. The video camera system according to claim 2, 
wherein said light-measuring method selection 
means selects said second average value of said 
recognized color extraction and light measurement 
means, said third average value of said centralized 
light measurement means, or said fourth average 
value of said spot light measurement means when 
said tracked object cannot be extracted so as to re- 
cover an operating state in which exposure control 
may be performed by said tracked object extraction 
and light measurement means. 

4. The video camera system according to claim 2, 
wherein said light-measuring method selection 
means selects said third average value of said cen- 
tralized light measurement means or said fourth av- 
erage value of said spot light measurement means 
when said tracked object is undetectable on a 
screen. 

5. The video camera system according to claim 2, 
wherein said light-measuring method selection 
means selects said third average value of said cen- 
tralized light measurement means or said fourth av- 
erage value of said spot light measurement means 
prior to initialization in which the characteristic val- 
ues are stored in said tracked object initialization 
means. 

6. The video camera system according to claim 1 , 
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wherein said tracked object extraction and light 
measurement means includes means for generat- 
ing said luminance reference value used for expo- 
sure control upon receiving a command signal from 
said tracked object initialization means. 5 

7. The video camera system according to claim 1 t 
wherein said recognized color extraction and light 
measurement means integrates said luminance in- 
formation having substantially the same color as the io 
recognized color in said picture information which 

is other than noise in a black object and environ- 
ment color in a white object to calculate the average 
value. 

is 

8. The video camera system according to claim 1, 
wherein said recognized color extraction and light 
measurement means initializes said recognized 
color in response to a command signal from said 
tracked object initialization means. 20 

9. The video camera system according to claim 1, 
wherein said tracked object initialization means in- 
cludes a storage switch arranged on said video 
camera, said storage switch being adapted to initi- '2s 
ate and/or terminate exposure operations of said 
video camera system. 

'10. The video camera system according to claim 1, 

wherein said tracked object initialization means in- 30 
eludes a storage switch arranged on one of a cable 
and a radio remote control for said video camera, 
said storage switch being adapted to initiate and/or 
terminate exposure operations of said video cam- 
era system. 35 

11. The video camera system according to claim 1, 
wherein said tracked object initialization means in- 
cludes a recording start switch of said video cam- 
era, said recording start switch being adapted to in- 40 
itiate and/or terminate exposure operations of said 
video camera system. 

12. The video camera system according to claim 1, 
wherein said tracked object initialization means in- 45 
eludes a recording start switch arranged on one of 

a cable and radio remote control for said video cam- 
era, said recording start switch being adapted to in- 
itiate and/or terminate exposure operations of said 
video camera system. 50 

1 3. A video camera exposure control method, compris- 
ing: 

dividing a video signal obtained from a video ss 
camera into luminance information and color in- 
formation, and storing picture information in- 
cluding said luminance information and color 



information in a temporary memory; 
recognizing, extracting and tracking a dis- 
played object in accordance with said picture 
information stored in said temporary memory; 
storing characteristic values of said tracked ob- 
ject; 

extracting and integrating only said luminance 
information of said tracked object so as to cal- 
culate a first average value; 
extracting said color information having the 
same color as said tracked object, and integrat- 
ing corresponding luminance information so as 
to calculate a second average value; and 
controlling an iris and/or an automatic gain con- 
troller of said video camera by utilizing said first 
average value or said second average value 
and by utilizing a luminance reference value, 
and adjusting the luminance of said object so 
as to be substantially constant. 

14. A video camera exposure control method, compris- 
ing: 

dividing a video signal obtained from a video 
camera into luminance information and color in- 
formation, and storing picture information in- 
cluding said luminance information and color 
information in a temporary memory; 
recognizing, extracting and tracking a dis- 
played object in accordance with said picture 
information stored in said temporary memory; 
storing characteristic values of said tracked ob- 
ject; 

extracting and integrating only said luminance 
information of said tracked object so as to cal- 
culate a first average value; 
extracting said color information having the 
same color as said tracked object, and integrat- 
ing said corresponding luminance information 
so as to calculate a second average value; 
integrating said luminance information of a first 
area in a center portion of a screen so as to 
calculate a third average value; 
integrating said luminance information in a sec- 
ond area around the center portion of said 
screen which is smaller than said first area so 
as to calculate a fourth average value; 
selecting said first average value, said second 
average value, said third average value, or said 
fourth average value in accordance with an ob- 
ject condition; and 

controlling an iris and/or an automatic gain con- 
troller of said video camera by using the select- 
ed luminance average value and a luminance 
reference value, and adjusting the luminance 
of said object so as to be substantially constant. 

15. The video camera exposure control method accord- 
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ing to claim 14, wherein the selecting step selects 
said second average value, said third average val- 
ue, or said fourth average value when said tracked 
object cannot be extracted so as to recover an op- 
erating state in which exposure control may be per- s 
formed by the step of extracting and integrating only 
said luminance information of said tracked object. 

16. The video camera exposure control method accord- 
ing to claim 1 4, wherein the selecting step selects *o 
said third average value or said fourth average val- 
ue when said tracked object is undetectable on a 
screen. 

17. The video camera exposure control method accord- 15 
ing to claim 14, wherein the selecting step selects 
said third average value or said fourth average val- 
ue prior to initialization in which the characteristic 
values are stored, during the storing step. 

20 

18. The video camera exposure control method accord- 
ing to claim 13, wherein the step of extracting only 
said luminance information of said tracked object 
includes generating said luminance reference value 
used for exposure control upon receiving a com- 2S 
mand signal. 

1 9. The video camera exposure control method accord- 
ing to claim 13, wherein the step of extracting said 
color information integrates said luminance infor- 30 
mation having substantially the same color as the 
recognized color in said picture information which 

is other than noise in a black object and environ- 
ment color in a wh ite object to calculate the average 
value. 35 

20. The video camera exposure control method accord- 
ing to claim 13, wherein the step of extracting said 
color information initializes said recognized color in 
response to a command signal. 40 

21 . The video camera exposure control method accord- 
ing to claim 1 3, wherein the video camera includes 
a storage switch arranged thereon and being adapt- 
ed to initiate and/or terminate exposure operations 45 
of said video camera. 

22. The video camera exposure control method accord- 
ing to claim 13, wherein the video camera includes 

a storage switch arranged on one of a cable and a so 
radio remote control for said video camera, said 
storage switch being adapted to initiate and/or ter- 
minate exposure operations of said video camera 
system. 

55 

23. The video camera exposure cont rol method accord- 
ing to claim 13, wherein the video camera includes 
a recording start switch of said video camera, said 



recording start switch being adapted to initiate and/ 
or terminate exposure operations of said video 
camera system. 

24. The video camera exposure control method accord- 
ing to claim 1 3, wherein the video camera includes 
a recording start switch arranged on one of a cable 
and radio remote control for said video camera, said 
recording start switch being adapted to initiate and/ 
or terminate exposure operations of said video 
camera system. 

25. A video camera system, comprising: 

picture information temporary storage means 
having a temporary memory for dividing a video 
signal obtained from a video camera into lumi- 
nance information and color information, and 
for storing picture information including said lu- 
minance information and aolor information in 
said temporary memory; 
object recognizing and tracking means for rec- 
ognizing, extracting and tracking a displayed 
object in said picture information stored in said 
temporary memory; 

tracked object extraction and light measure- 
ment means for extracting said luminance in- 
formation of said tracked object, for integrating 
only the extracted luminance information, and 
for averaging the integrated luminance infor- 
mation so as to produce a first average value; 
recognized color extraction and light measure- 
ment means for extracting objects having the 
same color as said tracked object, for integrat- 
ing corresponding luminance information of 
said objects, and for averaging the integrated 
information so as to produce a second average 
value; 

reference generating means for generating ref- 
erence luminance value signals; and 
exposure control means for controlling an ex- 
posure operation of said video camera by uti- 
lizing selected ones of said first and second av- 
erage values and said luminance reference val- 
ues so that the luminance of said object is prop- 
erly adjusted. 

26. A video camera system, comprising: 

picture information temporary storage means 
having a temporary memory for dividing a video 
signal obtained from a video camera into lumi- 
nance information and color information, and 
for storing picture information including said lu- 
minance information and color information in 
said temporary memory; 

tracked object extraction and light measure- 
ment means for extracting the luminance infor- 
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mation of a tracked object from the picture in- 
formation stored in said temporary memory, for 
integrating the extracted luminance informa- 
tion, and for averaging the integrated lumi- 
nance information so as to produce a first av- 5 
erage value; 

recognized color extraction and light measure- 
ment means for extracting other objects having 
the same color as said tracked object, for inte- 
grating corresponding I uminance information of 1 o 
said other objects, and for averaging the inte- 
grated information so as to produce a second 
average value; 

centralized light measurement means for inte- 
grating said luminance information of a first ar- is 
ea in a center portion of a screen, and for av- 
eraging the integrated luminance information 
so as to produce a third average value; 
refecence generating means for generating a 
plurality of reference luminance value signals; 20 
light-measuring method selection means for 
selecting (i) one of said first average value from 
said tracked object extraction and light meas- 
urement means, said second average value 
from said recognized color extraction and light 2s 
measurement means, and said third average 
value from said centralized light measurement 
means, and (ii) one of said reference luminance 
value signals in accordance with current oper- 
ating conditions; and 30 
exposure control means for controlling an ex- 
posure operation of said video camera by uti- 
lizing the selected ones of said first, second and 
third average values and said reference lumi- 
nance value* signals so that the luminance of 35 
said object is properly adjusted. 

27. A video camera system according to claim 26, fur- 
ther comprising spot light measurement means for 
integrating said luminance information in a second *o 
area around the center portion or said screen which 

is smaller than said first area, and for averaging the 
integrated information so as to produce a fourth av- 
erage value. 

45 

28. An apparatus for controlling an exposure of a video 
camera, said apparatus comprising: 

means for receiving a video signal having lumi- 
nance information and color information; 50 
a plurality of light measurement means for pro- 
ducing a plurality of luminance value signals 
from the received luminance and color informa- 
tion; 

means for generating a plurality of relerence lu- ss 
minance value signals; 

means for selecting one of the produced lumi- 
nance value signals and one of said reference 



luminance value signals; and 

means for controlling an exposure operation of 

said video camera by utilizing the selected ones 

of said produced luminance value signals and 

said reference luminance value signals so as 

to properly maintain the exposure of a desired 

object. 

29. A video camera exposure control method, compris- 
ing the steps of: 

dividing a video signal obtained from a video 
camera into luminance information and color in- 
formation, and for storing picture information in- 
cluding said luminance information and color 
information in a temporary memory; 
recognizing, extracting and tracking a dis- 
played object in said picture information stored 
in said temporary memory; 
extracting said luminance information of said 
tracked object, integrating only the extracted lu- 
minance information, and averaging the inte- 
grated luminance information so as to produce 
a first average value; 

extracting objects having the same color as 
said tracked object, integrating corresponding 
luminance information of said objects, and av- 
eraging the integrated information so as to pro- 
duce a second average value; * 
generating reference luminance value signals; 
and 

controlling an exposure operation of said video 
camera by utilizing selected ones of said first 
and second average values and said lumi- 
nance reference values so that the luminance 
of said object is properly adjusted. 

30. A video camera exposure control method, compris- 
ing the steps of: 

dividing a video signal obtained from a video 
camera into luminance information and color in- 
formation, and storing picture information in- 
cluding said luminance information and color 
information in a temporary memory: 
extracting the luminance information of a 
tracked object from the picture information 
stored in said temporary memory, integrating 
the extracted luminance information, and aver- 
aging the integrated luminance information so 
as to produce a first average value; 
extracting other objects having the same color 
as said tracked object, integrating correspond- 
ing luminance information of said other objects, 
and averaging the integrated information so as 
to produce a second average value; 
integrating said luminance information of a first 
area in a center portion of a screen, and aver- 
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aging the integrated luminance information so 
as to produce a third average value; 
generating a plurality of reference luminance 
value signals; 

selecting (i) one of said first average value, said s 
second average value and said third average 
value, and (ii) one of said reference luminance 
value signals in accordance with current oper- 
ating conditions; and 

controlling an exposure operation of said video 10 
camera by utilizing the selected ones of said 
first, second and third average values and said 
reference luminance value signals so that the 
luminance of said object is properly adjusted. 

75 

31 . The video camera exposure control method accord- 
ing to claim 30, further comprising the step of inte- 
grating said luminance information in a second area 
around the center portion of said screen which is 
smaller than said first area, and averaging the inte- 20 
grated information so as to produce a fourth aver- 
age value. 

32. A method for controlling an exposure of a video 
camera, said method comprising the steps of: 25 

receiving a video signal having luminance in- 
formation and color information; 
producing a plurality of luminance value signals 
from the received luminance and color informa- 30 
tion; 

generating a plurality of reference luminance 
value signals; 

selecting one of the produced luminance value 
Signals and one of said reference luminance 35 
value signals; and 

controlling an exposure operation of said video 
camera by utilizing the selected ones of said 
produced luminance value signals and said ref- 
erence luminance value signals so as to prop- 40 
erly maintain the exposure of a desired object. 
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(54) Exposure control for video cameras 

(57) A video camera system and method is capable 
of automatically controlling the exposure of a desired 
object image. A plurality of average luminance values 
(S7, S8, S9) are respectively determined by a plurality 
of light measurement units (1 2, 9, 10). A plurality of ref- 
erence luminance values (S10, S11) are obtained from 



a plurality of reference value circuits (13, 14). Selected 
ones of the average luminance values (S7, S8, S9) and 
the reference luminance values (S10, S11) are utilized 
to form control signals (S14). The control signals (S14) 
control a lens block section (50) of the video camera so 
as to maintain proper exposure of the desired object. 
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